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ABSTBACT 

To determine the effects of instruction and practice 
in a self-instructional prograa that had previously proven to be 
effective, 52 undergraduates vere randomly assigned to one of four 
treatment groups* One received the entire instructional program, the 
second received only instructional cues and examples, the third only 
the practice portion, and a fourth no portion of the program. 
Subjects receiving instruction achieved a significanlty higher aean 
score than subjects not receiving instruction. Practice did not 
inprove perf oraance* It vas concluded that if practice combined vith 
effective instruction did not ia prove learner performance, then 
practice tiie sight better be spent on instruction in other skills. 
(SK) 
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ABSTRACT 

The present stu4y was conducted to detemlne the effects of 
1nstruct1(Mfi and practice In a se1f-1nstruct1(ma1 program that had 
proven to be effective (80X of the learners Mho received the program 
correctly answered SOX of the Items on a posttest). Fifty- two under* 
graduate students. In an educational psychology course were randomly 
assigned to one of four treatment groups. One group received the 
entire Instructional program, a second group only received the 
Instruction (Instructional cues and examples) portion of the program, 
a third group only received the practice portion, and a fourth 
group did not receive any portion of the program. Sid)jects 
receiving Instruction achieved a significantly higher mean score 
on the posttest than subjects not receiving Instruction (p < .001). 
Practice did not Improve learner posttest performance. If practices 
when combined with effective Instruction, does not Improve learner 
posttest performance, then the time learners spend completing 
practice exercises might be better spent receiving Instruction on 
other skills. 
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THE EFFECTS OF INSTRUCTION AND PRACTICE 
IN AN EFFEaiVE INSTRUCTIONAL PROGRAM 

Robert A. Reiser 
Department of Educational Technology 
Arizona State University 

Many studies are designed to determine whether one type of instruc- 
tional material is better than another type of Instructional mateHal. 
However, one type of material might be significantly superior and still 
not be effective. The present study was conducted as part of a series 
of studies designed to detennine which instructional variables con- 
tribute to effective Instructional materials. Effective instructional 
matertals. as defined in this series of studies, are materials which 
enable 80% of the learners who receive the materials to correctly 
answer SOX of the items on a posttest. 

The Instructional material used in this stu<|y, the Aircraft 
Instrument Comprehension Program (Higgins, 1973), was developed, field 
tested, and revised until it was effective. The Aircraft Instrunent 
Comprehension Program is a self-instructional program designed to 
enable learners to idenf.ify which one of four illustrations of air- 
craft in flight most nearly represents the position indicated on an 
attitude indicator and a heading indicator. The program had been 
systematically developed to Include instruction (instructional cues 
and exjunples). practice, feedback, and an incentive. 

Previous studies that had been conducted with the Aircraft 
Instrument Comprehension Program had indicated that practice. 
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feedback, and Incentive did not significantly affect the posttest scores 
of learners (Higgins & Keams, 1973; Higglns, Keams, S Tenpas, 1974; 
Tenpas, 1974). Based on these results. It had been suggested that 
Instruction was the major factor contributing to learner posttest 
performance (Tenpas. 1974). However, practice had only been examined 
In a study Involving subjects who, prior to Instruction, were some- 
what proficient at perfoming the task being taught, as Indicated by 
the subjects' pretest scores. It had been suggested that pracltce 
might make a significant contribution to learner performance In cases 
where subjects were not familiar with the task (Tenpas, 1974). 

The purpose of the present study was to determine the Individual 
and combined effects of Instruction and practice on learner posttest 
performance on an aircraft Instrument comprehension task. Learners 
who were expected to be unfamiliar with the task being taught served 
as subjects. Two levels of Instruction (presence and absence) and 
two levels of practice (presence and absence) were manipulated In a 
2X2 factorial design. The dependent variables that were examined 
were learner posttest score on an aircraft Instrument comprehension 
task and learner rate of response on the posttest. 

Method 

Subjects 

The subjects In this study were 52 undergraduate students 
enrolled fn an educational psychology course at Arizona State 
University during the spring semester of 1974. These learners were 
expected to be unfamiliar with the task being taught. 



ERIC 



5 



Materials 

Tiie materials used In this study were variations of the self- 
Instructional program. Aircraft Instrument Comprehension Program 
(Higglns, 1973). This program Is designed to teach students to 
Identify which one of four Illustrations of an aircraft In flight 
most nearly represents the position Indicated on an attitude Indicator 
and a heading Indicator. These Indicators are used to determine the 
aircraft's pitch, bank, and heading. A sample Illustration of an 
aircraft In flight Is shown In Figure 1. A sample Illustration of an 
attitude Indicator and a heading Indicator Is shown In Figure 2. 



Insert Figure 1 and Figure 2 about here 

Instruction In the program consists of one Instructional cue 
and three examples for each of the three concepts presented: pitch, 
bank, and heading. There are also eight examples In which the various 
concepts are combined. 

Practice In the program consists of one to four practice Items 
following the Instruction for each concept. An additional 10 practice 
Items are Included at th^ end of the program. All practice Items 
require learners to Identify which one of two or more drawings of 
an aircraft In flight most nearly represents the position shown on 
an attitude Indicator and a heading Indicator. Learners are required 
to respond to the practice Items on a chemically-treated answer sheet 
which provides learners with feedback In the form of knowledge of 
correct response. 

6 
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Procedures 

Upon entering their classroom on the day of the studly, subjects 
were randomly assigned to one of four treatment groups. All groups 
remained In the classroom, but each group received a different set 
of materials. The Instruction and practice group received an Instruc- 
tional booklet with all Instructional cues, examples, and practice 
Items Intact. The Instruction only group received an Instructional 
booklet containing all Instructional cues and examples* however, all 
practice Items were deleted. The practice only group received an 
Instructional booklet containing all the practice Items, however, 
all the Instructional cues and examples were deleted. The control 
group received only a posttest booklet, they did not receive any 
Instructional cues, examples, or practice Items. 

When all subjects were seated., they were told they were partic- 
ipating In an experiment, and that they would receive extra credit 
toward their grade In the course because of their participation. 
They were also told that the first page of the booklet they had 
received explained how they could earn additional extra credit. 
Subjects were then told to begin reading the booklet that had been 
given to them. 

The first page of each booklet stated that all participants In 
the experiment would be taking a test and that If a participant's 
speed and score on the test exceeded a certain predetermined level, 
the participant would receive extra credit toward his grade In the 
course. It was also stated that various types of bookets had been 
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distributed to the participants and that the level a participant had 
to attain on the test would depend upon the type of booklet he had 
received. 

The last page of each booklet asked each subject to record the 
time he had finished his booklet and to raise his hand so that a 
proctor could collect his materials. A proctor diecked the completion 
time the subject had listed, collected the materials, and Instructed 
subjects who had taken the posttest that they could leave. Subjects 
who had completed a version of the Instructional program were given 
a copy of the posttest by the proctor, who recorded the subject's 
starting time. When the subject finished the posttest, he recorded 
his completion time, had his material collected by a proctor, and 
was dismissed. 
Criterion Measure 

The posttest that was administered was the Aircraft Instrument 
Comprehension Test; Form B (Keams. Tenpas, & Higglns, 1973). The 
test contains directions, a sample test Item, and 36 multlple-chctce 
test Items. All the test Items require learners to Identify which 
one of four aircraft In flight most nearly represents the position 
Indicated on an attitude Indicator and a heading Indicator. 
Data Analyses 

Analyses of data were performed to determine the Individual and 
combined effects of Instruction and practice on posttest scores and 
on posttest rates of response. 
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Results 

The posttest mean scores by treatment ar^ shown In Table 1. 



Insert Table 1 about here 

The mean score of 29.80 for groups receiving Instruction was almost 
14 points higher than the mean score of 15.84 for groups not receiving 
Instruction. Difference In mean score between groups receiving practice 
and groups not receiving practice vas less than one point. The results 
of a two-way analysis of variance, as shown In Table 2, revealed a 
statistically significant diffeitsnce attributable to Instruction, 
F (1, 48) « 82.i2, 2 < .001. The F-ratlos for practice and for the 
IntTiractlcn of practice and Instruction were not statistically 
significant. 



Insert Table 2 about here 

The time each subject spent answering items on the posttest W2» 
convened' to ia'rate*df responding by divldfng'the total number of 
Items by the subject's completion time. The mean posttest rates of 
responding by treatment are shown In Table 3. The m^n rates of the 



Insert Table 3 about here 

four treatment groups were all wUhIn .25 Items per minute from the 
overall mean rate of responding. The differences In posttest rates of 
responding did not approach statistical significance. 
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Discussion 

The purpose of the present stuify was to determine the Individual 
and combined effects of Instruction and practice on learner posttest 
performance on an aircraft Instruriient comprehension task. The study 
was part of a series of studies Initiated to determine the extent of 
the contribution of a number of Instructional variables to the effective 
ness of an effective self-Instructional program. The results of the 
stiMy Indicate that Instruction contributes greatly to the effective- 
ness of the program. Subjects receiving Instruction, consisting of 
Instructional cues and examples, achieved a significantly higher 
mean score on the posttest than did subjects not receiving Instruction. 
Subjects who did not receive Instruction were able to respond correctly 
to an average of only 44X of the Items on the posttest. Subjects 
receiving Instruction were able to correctly respond to an average of 
nearly S3X of the Items on the posttest. 

The powerful effect of Instruction m^y be attributable to the 
w^y the Instructional cues and examples In the program were developed. 
The first step In the developmental process was an analysis of the task 
the learners were expected to perform. An Instructional objective, 
describing the task to be performed, as then written. After the 
objective had been specified, the Information a learner would need In 
order to perform the objective was determined. Instructional cues and 
examples, containing the needed Information, were then, generated. This 
systematic development of cues and examples, aimed specifically at 
providing the learner with the Inforamtlon nctcessairy to perform the 
objective, mqy account for the rather high level of performance of 



8 



the subjects viho did receive Instruction. 

The powerful effect of Instruction on subject posttest performance 
had previously been hypothes1:^d (Tenpas. 1974). It had also been 
hypothesized that practice might have a significant effect on subject 
posttest performance in cases where subjects were unfamiliar with the 
tnsk being taught (Tenpas, 1974). The mean posttest score (15.07* 
out of a possible 36) of the control group, the group that received 
neither Instruction oor practice. Indicates that s'lbjects used In the 
present stud^f were, prior to Instruction, rather unfamiliar with the 
task. However, practice did not have a significant effect on subject 
posttest performance, despite the subjects' anfamlllarfty with the task. 

Results of the stu(j|y Indicate that practice alone does not enable 
subjects unfamiliar with the aircraft Instrument comprehension task to 
learn how to perform It correctly. The results also Indicate that when 
practice Is combined with effective Instruction, practice does not • 
Improve learner performance. If practice, when combined with effective 
Instruction, does not Improve learner performance, then the time learners 
spend completing practice exercises might be better spent receiving 
Instruction on other skills. Future research should be conducted to 
determine whether practice does contribute to the effectiveness of 
effective Instructional materials. 
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TABLE 1 

Posttest Mean Scores by Treatment 







Practice 






Instruction 

Practice 




No Practice 


Totals 


Instruction 28.07 




31.53 


29.80 


,No Instruction 16.61 




15.07 


15.84 


Totals 22.34 




23.30 


22.82 


N » 13 per cell 


TABLE 2 






Analysis of Variance: Posttest Scores 






Source of Variation 


SS df 




F-Ratio 


Instruction 


2534.02 1 


2534.02 


82.62* 


Practice 


12.02 1 


12.02 


.39 NS 


Instruction X Practice 


81.25 1 


81.25 


2.65 NS 


Within 


1472.02 48 


30.67 





*£ < .001 

NS « Not Significant 



TABLE 3 

Mean Posttest Rates of Responding by Treatment 





Instruction 


Practice 


Practice 

No Practice 


Totals 


Instruction 


2.70 


2.43 


2.57 


No Instruction 


2.85 


2.71 


2.78 


Totals 


2.78 


2.57 


2.68 



N = 13 per cell 

Note . Rate of responding Is listed as Items per minute. 
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FIGURE 1 

Illustration of Aircraft in Flight 




FIGURE 2 

Illustration of Instrument Panel 



















ATTITUDE 


HEADING 


INDICATOR 


INDICATOR 



